Robust Principal Component Analysis with Non-Greedy l1-Norm Maximization
نویسندگان
چکیده
Principal Component Analysis (PCA) is one of the most important methods to handle highdimensional data. However, the high computational complexitymakes it hard to apply to the large scale data with high dimensionality, and the used 2-norm makes it sensitive to outliers. A recent work proposed principal component analysis based on 1-normmaximization, which is efficient and robust to outliers. In that work, a greedy strategy was applied due to the difficulty of directly solving the 1-norm maximization problem, which is easy to get stuck in local solution. In this paper, we first propose an efficient optimization algorithm to solve a general 1-norm maximization problem, and then propose a robust principal component analysis with non-greedy 1-norm maximization. Experimental results on real world datasets show that the nongreedy method always obtains much better solution than that of the greedy method.
منابع مشابه
Non-Greedy L21-Norm Maximization for Principal Component Analysis
Principal Component Analysis (PCA) is one of the most important unsupervised methods to handle highdimensional data. However, due to the high computational complexity of its eigen decomposition solution, it hard to apply PCA to the large-scale data with high dimensionality. Meanwhile, the squared L2-norm based objective makes it sensitive to data outliers. In recent research, the L1-norm maximi...
متن کاملRobust Tensor Clustering with Non-Greedy Maximization
Tensors are increasingly common in several areas such as data mining, computer graphics, and computer vision. Tensor clustering is a fundamental tool for data analysis and pattern discovery. However, there usually exist outlying data points in realworld datasets, which will reduce the performance of clustering. This motivates us to develop a tensor clustering algorithm that is robust to the out...
متن کاملAvoiding Optimal Mean Robust PCA/2DPCA with Non-greedy ℓ1-Norm Maximization
Robust principal component analysis (PCA) is one of the most important dimension reduction techniques to handle high-dimensional data with outliers. However, the existing robust PCA presupposes that the mean of the data is zero and incorrectly utilizes the Euclidean distance based optimal mean for robust PCA with `1-norm. Some studies consider this issue and integrate the estimation of the opti...
متن کاملAvoiding Optimal Mean Robust PCA/2DPCA with Non-Greedy l1-Norm Maximization
1 -Norm Maximization Minnan Luo, Feiping Nie,2⇤ Xiaojun Chang, Yi Yang, Alexander Hauptmann, Qinghua Zheng 1 Shaanxi Province Key Lab of Satellite-Terrestrial Network , Department of Computer Science, Xi’an Jiaotong University, P. R. China. 2 School of Computer Science and Center for Optical Imagery Analysis and Learning, Northwestern Polytechnical University, P. R. China. Centre for Quantum Co...
متن کاملAngle Principal Component Analysis
Recently, many l1-norm based PCA methods have been developed for dimensionality reduction, but they do not explicitly consider the reconstruction error. Moreover, they do not take into account the relationship between reconstruction error and variance of projected data. This reduces the robustness of algorithms. To handle this problem, a novel formulation for PCA, namely angle PCA, is proposed....
متن کامل